Resbinnet: Residual Binary Neural Network
ثبت نشده
چکیده
Recent efforts on training light-weight binary neural networks offer promising execution/memory efficiency. This paper introduces ResBinNet, which is a composition of two interlinked methodologies aiming to address the slow convergence speed and limited accuracy of binary convolutional neural networks. The first method, called residual binarization, learns a multi-level binary representation for the features within a certain neural network layer. The second method, called temperature adjustment, gradually binarizes the weights of a particular layer. The two methods jointly learn a set of soft-binarized parameters that improve the convergence rate and accuracy of binary neural networks. We corroborate the applicability and scalability of ResBinNet by implementing a prototype hardware accelerator. The accelerator is reconfigurable in terms of the numerical precision of the binarized features, offering a trade-off between runtime and inference accuracy.
منابع مشابه
ResBinNet: Residual Binary Neural Network
Recent efforts on training light-weight binary neural networks offer promising execution/memory efficiency. This paper introduces ResBinNet, which is a composition of two interlinked methodologies aiming to address the slow convergence speed and limited accuracy of binary convolutional neural networks. The first method, called residual binarization, learns a multi-level binary representation fo...
متن کاملEstimation of Binary Infinite Dilute Diffusion Coefficient Using Artificial Neural Network
In this study, the use of the three-layer feed forward neural network has been investigated for estimating of infinite dilute diffusion coefficient ( D12 ) of supercritical fluid (SCF), liquid and gas binary systems. Infinite dilute diffusion coefficient was spotted as a function of critical temperature, critical pressure, critical volume, normal boiling point, molecular volume in normal boilin...
متن کاملStudy of Surface Tension of Binary Mixtures of Poly (Ethylene Glycol) in Water and Poly (Propylene Glycol) in Ethanol and its Modeling Using Neural Network
متن کامل
Prediction of true critical temperature and pressure of binary hydrocarbon mixtures: A Comparison between the artificial neural networks and the support vector machine
Two main objectives have been considered in this paper: providing a good model to predict the critical temperature and pressure of binary hydrocarbon mixtures, and comparing the efficiency of the artificial neural network algorithms and the support vector regression as two commonly used soft computing methods. In order to have a fair comparison and to achieve the highest efficiency, a comprehen...
متن کاملApplying Pareto Design of GMDH-Type Neural Network for Solid-Liquid Equilibrium of Binary Systems (Isotactic Poly 1-Butene (1)-Organic Solvents (2))
Isotactic poly (1-butene), ipbu-1, was synthesized by using a metallocene catalyst. The thermodynamic phase behavior of polymer–organic solvents systems is very important in every polymer application. In this paper, the solid–liquid equilibrium of ipbu-1 with different organic solvents (1-heptyne, cyclo octane) was studied by a mathematical model. By considering the experiments temperature...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2017